The recognition of finger-spelling alphabets for Chinese sign language
نویسندگان
چکیده
As a primary component of Chinese Sign Language(CSL), finger-spelling language plays an important role in deaf education and their communication. With the help of spelling rule, the system that can recognize the alphabet flow can understand and interpret CSL. So in this paper the method of effective frame extraction is proposed and used to eliminate the transition frames in the alphabet flow. And Artificial Neural Network (ANN) is introduced to recognize Chinese finger-spelling alphabet, in which a kind of fast multi-layer neural network learning algorithm-Single Parameter Dynamic Search Algorithm(SPDS) is used to learn net parameters. In addition, a recognition algorithm for finger-spelling alphabet based on multi-feature and multi-classifier is proposed and used to promote the recognition performance of alphabet. At last real-time finger-spelling language recognition system is implemented based on the above algorithm. From experiment result, it is shown that Chinese finger-spelling alphabet recognition based on multi-feature and multi-classifier outperforms its recognition based on single-classifier.
منابع مشابه
Comparison Between Modes of Communication for the Deaf and Dumb via e-Learning Through Case Study (sign language and finger spelling in review)
Communication between student and learning source represents the main media for the teaching / learning process. For Deaf and Dumb (D&D) such communication could be processed via speech visualization media. All the oral/audio instructional material could be translated into the corresponding material via visual mode. Three main modes of communication for the D&D are commonly used. They are alpha...
متن کاملVisual Interpretation of ASL Finger Spelling using Hough Transform and Support Vector Machine
This paper proposes a vision based automated system for interpretation of American Sign Language (ASL) finger spelling using image processing. A graphical user interface is developed for the hard of hearing community to interact with normal hearing persons through hand gestures in a natural way thereby eliminating the need for an interpreter. This system does not require the user to wear any da...
متن کاملAppearance Based Recognition Methodology for Recognising Fingerspelling Alphabets
In this paper, a study on the suitability of an appearance based model, specifically PCA based model, for the purpose of recognising fingerspel-ling (sign language) alphabets is made. Its recognition performance on a large and varied real time dataset is analysed. In order to enhance the performance of a PCA based model, we suggest to incorporate a sort of pre-processing operation both during t...
متن کاملAutomatic Recognition of Auslan Finger-spelling using Hidden Markov Models
In recent years, gesture recognition has received much attention from research communities. Computer vision-based gesture recognition has many potential applications in the area of human-computer interaction as well as sign language recognition. Sign languages use a combination of hand shapes, motion and locations as well as facial expressions. Finger-spelling is a manual representation of alph...
متن کاملFinger spelling recognition using distinctive features of hand shape
The authors have been developing a glove based input device, called “Stringlove”, recognizing finger shapes by adapting for several shapes pointing an angle of each finger joint. A research group reports on the sign language linguistics features to distinguish finger shapes, and advance to make it practicable to engineering. This paper mentions that the method of recognition of finger shapes wa...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2001